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FOREWORD 


In  1980,  the  Assistant  Secretary  of  Defense  directed  all 
services  to  pursue  a  long-range  systematic  program  to  validate 
the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB)  and  to 
reevaluate  enlistment  standards  and  on-the-job  performance.  As  a 
result,  the  Army  has  sponsored  two  major  research  efforts.  The 
first  effort,  known  as  Project  A,  investigated  the  validity  of 
the  ASVAB  and  several  new  predictor  measures  for  a  sample  of 
diverse  military  occupational  specialties  (MOS) .  The  second 
effort,  the  Army's  Synthetic  Validity  Project  (SYNVAL) ,  con¬ 
sidered  both  synthetic  validation  techniques  for  determining  MOS 
specific  selection  composites  and  evaluation  of  methods  for 
setting  standards  on  these  composites. 

In  theory,  adoption  of  selection  standards  should  be  asso¬ 
ciated  with  assessment  of  performance  standards.  This  report 
provides  a  preliminary  theoretical  framework  for  analyzing  the 
role  of  performance  standards  and  their  relationship  to  the 
affective  and  behavioral  reactions  of  job  incumbents.  This 
framework  will  provide  guidance  in  generating  hypotheses  about 
performance  standards  and  help  guide  future  research  in  this 
domain.  Further  development  of  the  ideas  in  this  report  will 
lead  to  increased  understanding  of  performance  standards  in  the 
scientific  community  and  to  production  of  more  accurate  and  well- 
defined  procedures  for  standard  setting  in  the  U.S.  Army. 


EDGAR  M.  JOriwSON 
Technical  Director 
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SETTING  PERFORMANCE  STANDARDS:  A  REVIEW  OF  RELATED  LITERATURES 
AND  IDENTIFICATION  OF  FUTURE  RESEARCH  NEEDS 


EXECUTIVE  SUMMARY 


Requirement: 

This  report  provides  basic  information  critical  for  deter¬ 
mining  the  directions  for  future  research  and  the  selection  and 
evaluation  of  standard-setting  methodologies  for  the  U.S.  Army. 


Procedure: 

While  the  literature  directly  addressing  performance  stand¬ 
ards  is  scant,  there  is  a  variety  of  related  scientific  litera¬ 
ture  that  is  useful  for  thinking  about  setting  performance  stand¬ 
ards  and  job  incumbents'  reactions  to  those  standards.  For  this 
project,  the  authors  conducted  a  literature  review  of  these  do¬ 
mains,  including  literatures  in  education,  goal  setting,  perfor¬ 
mance  appraisal  and  feedback,  utility  analysis,  and  job  satis¬ 
faction.  During  this  literature  review,  they  developed  an 
initial  model  of  aspects  of  the  standard  setting  process  that 
influence  affective  and  behavioral  reactions  of  job  incumbents. 
This  model  attempted  to  compare  and  synthesize  findings  from  the 
related  literatures  listed  above.  The  authors  also  identified 
research  needs  for  basic  researchers  in  the  field  and  considered 
how  these  needs  might  be  stated  within  U.S.  Army  contexts. 


Findings : 

From  the  model  and  literature  review,  the  authors  identified 
a  variety  of  research  suggestions  and  presented  a  set  of  thirteen 
global  hypotheses  that  require  basic  empirical  research  in  the 
future.  They  categorized  all  research  needs  into  four  groupings: 
the  definitional  content  of  performance  standards,  the  difficulty 
levels  of  standards,  the  ease  of  internalization  of  external  per¬ 
formance  standards,  and  the  communication  of  standards.  While 
the  specific  hypotheses  are  too  numerous  to  mention  here,  the 
basic  tenet  of  the  model  was  that  external  performance  standards 
may  be  internalized  by  job  incumbents  in  many  ways  and  that  the 
process  needs  to  be  managed  with  care  so  that  incumbent  motiva¬ 
tion  and  affective  reactions  are  as  intended.  The  authors  con¬ 
clude  that  standard  setting  procedures  should  incorporate  both 
absolute  levels  and  positive  changes  in  performance,  that  con¬ 
tinuous  utility  functions  can  help  identify  multiple  levels  of 
standards,  and  that  a  consistency  between  organizational  and 
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individual  values  will  increase  the  likelihood  that  external 
standards  are  internalized. 


Utilization  of  Findings: 

This  paper  presents  a  series  of  research  needs  required  for 
an  understanding  of  how  individuals  react  to  setting  organiza¬ 
tional  performance  standards.  Results  of  such  basic  research 
should  allow  U.S.  Army  decision  makers  to  better  manage  setting 
and  communication  of  performance  standards  so  that  they  are 
internalized  by  job  incumbents,  increase  incumbent  satisfaction, 
and  increase  incumbent  motivation  and  performance. 
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SETTING  PERFORMANCE  STANDARDS:  A  REVIEW  OF  RELATED  LITERATURES 
AND  IDENTIFICATION  OF  FUTURE  RESEARCH  NEEDS 


INTRODUCTION 


The  intent  of  this  review  is  to  motivate  research  in  a  crucial, 
but  neglected  area:  how  individuals  react  to  the  setting  of  performance 
standards.  The  notion  of  "standard*'  (e.g. ,  as  in  "selection  standard" 
or  "performcince  standard")  is  ubiquitous  in  its  use  within  both  private 
and  public  sector  orgemizations.  However,  research  on  standard  setting 
has  almost  exclusively  focused  on  selection  standards  (e.g.,  the 
educational  literature  noted  below).  Indeed,  Cascio,  Alexander,  and 
Barrett  (1988)  provide  an  excellent  review  of  selection  standards  and 
the  setting  of  cut-off  scores  within  a  legal  context.  On  the  other 
hand,  the  textbook  approach  to  human  resources  management  meikes  it 
clear  that  a  focus  on  performance  (e.g.,  a  good  job  analysis)  is 
necessary  before  ciny  informed  decisions  can  be  made  about  selection, 
training,  or  performance  appraisal  systems.  For  example,  requirements 
about  performance  standards  should  directly  inform  optimal  selection 
standards.  However,  there  is  little  (if  any)  resezurch  directly  related 
to  how  organizations  set  performance  standards,  whether  the  purposes  of 
the  standeurd  setting  cure  met,  or  whether  inappropriate  performance 
standards  can  lead  to  dysfunctional  outcomes  (Murphy  *  Cleveland, 

1991) .  While  the  literature  here  is  scant,  it  is  assumed  that  related 
literatures  (e.g.,  perfoimance  appraisal,  goal  setting,  utility 
analysis,  job  satisfaction)  can  help  delineate  future  research  needs  in 
our  understanding  of  the  purposes  and  procedures  for  setting 
performance  standards. 


What  is  a  Performance  Standard? 

Dictionaries  present  many  definitions  of  the  word  "standard."  Fdr 
exauple,  the  Webstar^s  definition  most  directly  related  to  the  setting  of 
perfooBanoe  criteria  is 

3:  scmething  established  by  authority,  custcm,  or  general 
consent  as  a  model  or  exanrle:  CRETERICN  fWd»ter^s  Seventh 
New  collegiate  Dictionary.  1965,  p.  853) 

It  is  clear  from  this  definition,  and  common  organizational  usage,  that 
there  are  three  features  that  define  standards.  First,  staniazds  iaply 
evaluation,  as  noted  by  the  definitioned  use  of  the  term  "criterion." 

Second,  standards  are  criteria  that  are  established  externally  and 
imposed  on  an  individual's  work  task.  In  this  sense,  they  do  not 
necessarily  specify  individual  or  organizational  intentions  of  desired 
performance  levels.  As  noted  later,  "standards"  are  therefore  to  be 
distinguished  from  "goals"  in  the  sense  that  goals  are  performanoe 
benchmarks  that  are  intended  to  be  2Klopted  internally  by  the 
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individual  euid  function  to  direct  behavior.  Finally,  steindards,  as 
established  entities,  are  usually  considered  to  remain  somewhat  stable 
over  time  and  individuals,  therefore  further  distinguishing  them  from 
goals  or  objectives. 

Some  textbooks  equate  performance  standards  with  "minimiam 
standards"  of  performance  (cf.  Caurroll  &  Schneier,  1982,  p.  131). 
However,  this  view  is  myopic  since  standards  can  be  set  for  a  wide 
range  of  performance  levels.  For  example,  a  cursory  review  of  a  local 
newspaper  for  one  week  revealed  that  performance  stemdards  could  also 
be  used  to  define  "stauidards  for  excellence"  (in  two  eurticles  about 
standards  for  excellence  in  athletes  emd  maintenance  of  high  standards 
in  a  public  school  system) .  Thus,  our  perspective  is  one  with  a 
performcmce  continuum  (from  very  poor  performemce  to  outstanding 
performance) ,  where  standards  can  be  used  to  define  anv  point  along 
that  continuum.  For  exeunple,  as  illustra'*‘ed  by  Bobko  amd  Wise  (1987), 
one  could  define  a  continuum  of  performance  standards  as 

(a)  a  "minimiim  standard"  —  below  which  a  person  was  demoted  or 
fir ad.  Presxmably,  such  a  person  would  have  negative  utility 
to  the  organization. 

(b)  a  "training  wairning  standard"  —  below  which  some  action  was 
required  for  remediation  (e.g.,  retraining). 

(c)  an  "acceptable  stemdard"  —  requiring  no  action  on  the  part 
of  the  organization. 

(d)  an  "excellence  standard"  —  above  which  a  positive  reward 
would  be  provided. 

We  also  note  that  performance  standards  are  value  judgments.  That 
is,  these  established  standeurds  are  externally  set,  defined,  and 
operationalized  by  supervisors,  or  management,  or  unions,  or  peer 
advisory  groups,  etc.  Wherever  they  come  from,  there  is  no  "ultimate 
criterion"  against  which  to  judge  what  the  "right"  stamdard  is.  The 
educational  literature  most  cleeurly  points  out  the  subjective  nature  of 
standards  and  the  judgments  underlying  them  (Glass,  1978) .  As  Cronbach 
(1949)  states  when  discussing  the  setting  of  any  cut-off  scores,  "The 
choice  ...  cannot  be  made  scientifically.  It  is  based  on  personal, 
social,  and  economic  values,  combined  with  practical  considerations." 
(p.424).  In  fact,  this  subjectivity  is  what  leads  us  to  conclude  that 
research  is  needed  to  systematize  our  knowledge  about  how  performance 
standards  are  set,  how  they  should  be  set,  their  impact  on 
organizational  performance,  and  their  impact  on  affective  reactions  to 
the  workplace. 

Finally,  it  is  useful  to  draw  a  distinction  between  job 
performance  standards  and  the  selection  standards  mentioned  earlier. 
Selection  standards  refer  to  cut-off  scores  on  some  selection  criteria 
(paper  and  pencil  tests,  interviews,  etc.).  The  purpose  of  these 
standards  is  to  select  individuals  who  are  expected  to  perform  well  on 
the  job.  Our  use  of  the  term  "performance  standard"  refers  to  standards 
concerning  any  aspect  of  an  individual's  performance  once  he  or  she  has 
entered  the  organization.  Thus,  performance  standards  can  be  app]  id  to 


2 


numerous  domains  of  performance  (e.g. ,  prcmiptness,  technical  knowledge, 
and  specific  task  competency) .  These  performance  steindards  can  serve 
many  purposes  relating  to  personnel  decisions  such  as  training,  firing, 
and  promotion. 


A  Framework  for  Thinking  About  Performance  Standards 

In  line  with  the  above  definition  of  standards,  Carroll  and 
Schneier  (1982)  state  that  performance  steindards  2u:e  "criteria  against 
v^cii  to  ev2duate  performanoe."  Most  research  on  standards  (prinarily 
in  the  educational  literature)  has  focused  on  methods  of  setting 
standards  so  that  they  accurately  describe  ^^ecified  performanoe 
levels.  Also,  as  noted  abovr,  this  reseEuxh  has  lainly  demonstrated 
that  debits  careful  methodology,  resulting  standards  zure  vzdue 
judgments  and  that  different  techniques  will  lead  to  different 
standards  reflecting  the  same  perfarmanoe  level.  A  recent  example 
of  this  is  the  U.S.  Army's  synthetic  validity  (SYNVAL)  project  (see 
Wise,  Peterson,  Hoffman,  Canpbell,  &  Arabian,  1991)  \«here  two  dif¬ 
ferent  standard  setting  procedures  were  used:  a  task-based  e^:proach 
and  a  behavioral  incident  approach.  Ihe  ta^-based  eqpproach  led  to  a 
"margijial"  standard  in  vhlch  29%  of  current  soldiers  fedled  to  meet  the 
cut-off,  vhereas  the  bdvivioral  incident  z^proach  led  to  a  "marginal" 
standard  that  only  6%  of  current  soldiers  fzdled  to  meet.  Ihus,  giv^  a 
multiplicity  of  methodologically  sound  procedures  for  developing  stand¬ 
ards,  the  question  still  remains  zis  to  how  an  orgzmization  should 
choose  a  standard-setting  procedure. 

A  major  issue  that  may  help  clarify  the  above  question  but  has 
previously  been  ignored  in  the  standard  setting  literature  is  how 
individuals  react  to  steindards.  Generally,  organizational  concern  has 
been  with  the  evaluative  potential  of  performance  standards,  e.g. , 

"does  a  marginal  stemdard  really  reflect  marginal  performance?" 

However,  when  performance  standeirds  are  communicated  and  applied,  those 
to  whom  the  standards  apply  will  most  likely  have  some  reaction  to  the 
standard,  especially  since  standards  are  used  to  make  personnel 
decisions.  For  exeimple,  considering  the  above  SYNVAL  results,  soldiers 
would  be  likely  to  have  different  reactions  to  a  standard  in  which  only 
70%  of  then  W3Uld  be  at  least  "marginal,"  ccopared  to  the  other  system 
in  ^^ch  94%  wxild  be  at  least  "marginal." 

The  purpose  of  this  paper  is,  therefore,  to  encourage  thinking 
about  how  performance  standeirds  may  influence  reactions  of  those  to 
whom  the  steindards  apply.  Figure  1  is  a  schematic  representation  of  the 
main  points  to  be  made  in  this  paper.  We  argue  that  different  aspects 
of  setting  performance  standards,  such  as  the  difficulty  cind 
communication  of  standards,  will  influence  whether  or  not  these 
performance  standards  are  internalized.  In  other  words,  the  way  in 
which  standards  are  set  can  impact  on  whether  or  not  individuals 
accept,  or  at  least  attend  to,  organizational  performance  standards. 
Once  external  standards  are  internalized,  then  two  types  of  reactions 
can  occur.  First,  individuals  may  have  an  affective  reaction  toward  the 
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organization,  job,  or  the  individuals  applying  the  standards.  For 
exaaple,  standards  viewed  as  too  difficult  or  as  being  set  unfairly  may 
lead  people  to  be  less  satisfied  with  their  job.  Affective  reactions 
would  then  be  related  to  turnover  and  retention  (Mobley,  Griffeth, 

Heind,  &  Meglino,  1979) .  Second,  individuals  may  have  a  motivational 
reaction  to  the  standard.  For  example,  stamdards  viewed  as  too 
difficult  may  lead  employees  to  just  give  up  and  be  demotivated.  On  the 
other  hamd,  it  may  be  possible  to  set  standards  which  will  actually 
increase  motivation.  The  motivating  potential  of  standards  should  be 
related  to  employee  performamce  within  the  environmental  constraints 
which  make  this  possible.  Thus,  this  paper  draws  a  link  from  the 
setting  of  performance  stamdards  to  their  impact  on  orgamizational  amd 
individual  effectiveness  by  discussing  how  performance  standards  may 
influence  employees'  motivational  and  affective  reactions. 


figure  1.  Underlying  model  of  employee  reactions  to  performance 
standards . 
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The  issue  of  employee  reactions  to  performance  standards  has  gone 
essentially  unresearched.  Thus,  we  review  other  lines  of  research  which 
have  implications  for  the  influence  of  standards  on  eii5)loyee  reactions 
to  those  standards.  Specific  literatures  reviewed  are:  goal  setting, 
performance  appraisal,  feedback,  framing,  utility  analysis,  and  job 
satisfaction.  The  end  result  is  a  section  which  puts  forth  specific 
hypotheses  (when  possible)  and  outlines  future  research  directions. 
These  research  directions  are  related  to: 

-  the  difficulty  of  the  standards  being  set. 

-  the  content  of  the  standaurds  being  expressed:  How  specific 
should  the  standards  be?  Should  performance  feedback  be  given  in 
positive  or  negative  frames  (half  full  vs.  half  empty)? 

-  the  suitability  of  absolute  standards  versus  standards  based  on 
percentage  change. 

-  the  decision  about  who  has  input  into  the  standard  setting 
procedures . 

-  the  communication  of  standaurds. 

Finally,  we  briefly  present  the  iit^jlications  of  our  hypotheses  for  the 
application  of  staindard  setting  procedures  within  the  Army  context. 


A  REVIEW  OF  RELATED  LITERATURES 
Standard  Setting  in  Education 

While  there  is  little  reseaurch  on  performance  standards  in  the 
organizational  literature,  educational  researchers  have  suggested  and 
studied  procedures  for  setting  standards  —  usually  in  the  arenas  of 
pupil  diagnosis,  certification,  or  program  evaluation  (Shepard,  1980) . 
Reviews  of  this  literature  may  be  found  in  Berk  (1986),  Hcimbleton  and 
Eignor  (1979),  Jaeger  (1976),  Pulakos,  Wise,  Arcibian,  Heon,  and 
Delaplane  (1989),  and  Shepard  (1980).  The  two  major  approaches  to 
developing  standards  involve  (i)  judgments  cibout  test  content  or  (ii) 
judgments  about  mastery  vs.  non-mastery  groups.  Note  that  both 
approaches  cure  judgmental  in  nature. 

Angoff  (1971),  Nedelsky  (1954),  emd  Ebel  (1972)  have  all  proposed 
standard  setting  methodologies  which  require  judgments  about  item 
content.  For  excunple,  the  Angoff  procedure  asks  judges  to  consider  a 
minimally  qualified  individual  and  estimate  the  probability  that  such  a 
person  would  answer  each  item  correctly.  The  sum  of  such  probabilities, 
across  all  items  in  a  test,  provides  cm  estimate  of  where  the  standard 
(cut-off  score)  should  be  set.  The  Nedelsky  method  is  similar,  but  asks 
judges  to  arrive  at  these  probability  estimates  by  first  casting  out 
options  (on  multiple  choice  items)  which  minimally  competent 
individuals  would  clearly  know  cure  wrong.  In  the  Ebel  method,  items  are 
additionally  stratified  by  relevance  and  difficulty  (such 
categorizations  are  also  made  by  the  judges).  Several  reviews  (Berk, 
1986;  Hambleton  &  Eignor,  1979)  have  concluded  that  the  Angoff  method 
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is  favored  (due  to  its  simplicity  and  technical  adequacy)  over  other 
item-based,  or  mastery-qroup  based,  procedures. 

Zieky  and  Livingston  (1977)  offered  two  standard  setting 
procedures  based  on  judgments  about  groups  of  individuals,  rather  than 
judgments  about  items.  In  the  "contrasting  groups"  method,  judges 
identify  individuals  who  are  clearly  either  "masters"  or  "non-masters" 
and  a  cutoff  score  on  the  test  in  question  is  set  such  that  the  two 
groups  are  maximally  discriminated.  Zieky  emd  Livingston's  "borderline 
group  method"  is  similar,  but  only  operates  on  individuals  identified 
as  borderline.  The  cut-score  is  then  set  at  the  median  of  this  group. 

Studies  which  have  empirically  compared  standard  setting  methods 
in  education  have  found  that  different  standard  setting  methods  can 
yield  substantially  different  results  (Andrew  &  Hecht,  1976;  Brennan  & 
Lockwood,  1980;  Halpin  &  Halpin,  1983,  Koffler,  1980;  Skakun  &  Kling, 
1980) .  This  is  not  surprising,  given  that  standards  are  judgments  of 
value,  and  given  the  variety  of  frames  of  reference  in  the  standard 
setting  methods,  potential  differences  in  the  types  of  judges  used,  and 
differences  in  types  of  stimuli  used  (items,  individuals  who  are 
masters,  individuals  who  are  borderline,  etc.). 

Other  methods  for  setting  standards  have  been  proposed  which 
involve  the  use  of  external  criterion  measures  and  a  decision- theoretic 
evaluation.  Shepard  (1980)  calls  these  methods  "empirical  methods  for 
adjusting  standards".  For  example,  assume  there  is  some  dichotomous, 
external  criterion  (e.g. ,  "successful"  vs.  "imsuccessful") .  Then  cut- 
points  on  a  selection  test  can  be  evaluated  from  the  number  (and  cost) 
of  both  false  positives  and  false  negatives  when  using  the  selection 
cutoff  to  predict  group  membership  on  the  criterion.  Of  course  the 
problem  with  this  technique  is  apparent:  it  begs  the  fundamental 
question  by  assuming  that  there  is  a  (dichotomous)  standard  of 
performance  available.  Thus,  such  methods  are  not  useful  for  setting 
performance  standards,  where  the  very  assumption  is  the  central  issue. 

Pulakos  et  al.  (1989)  note  two  further  application  problems  in 
using  the  educational  literature  for  setting  job  performance  standards. 
First,  examinee-based  methods  (e.g.,  those  of  Zieky  emd  Livingston)  may 
be  susceptible  to  range  restriction  when  judges  attempt  to  identify  the 
full  range  of  performance.  That  is,  "unacceptable"  performers  may  exist 
only  in  minimal  numbers  in  the  reality  of  some  organizations  (due  to 
the  effects  of  good  training  procedures  or  attrition  of  poor 
performers) ,  while  exceptionally  high  performing  individuals  may  have 
been  promoted  out  of  the  job.  Second,  Pulakos  et  al.  (1989)  note  "item- 
based  methods  do  not  . . .  hold  much  promise  for  use  in  conjunction  with 
continuously  scored  performance  measures  (e.g.,  rating  scales)"  (p.25) . 
That  is,  estimating  the  probadsility  that  a  "master"  will  get  a  rating 
scale  item  "correct"  makes  little  sense.  To  solve  this  dilemma  for 
behaviorally  anchored  rating  scales  (BARS),  Pulakos  et  al.  suggest  that 
future  researchers  might  ask  judges  to  sort  critical  incidents  into  t\<o 
categories  ("below  minimum  competency"  and  "above  minimum  competency’") 
and  identify  a  scale  value  on  the  BARS  which  represents  a  minimum 
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performance  standard. 


Finally,  Shepard  (1980)  identified  two  additional  methodological 
issues  when  standards  are  being  set.  First,  wherever  a  standard  is  set 
on  a  particular  continuum,  “individuals  on  either  side  of  the  standard 
will  be  virtually  indistinguishable  from  one  another"  (p.448) .  This 
implies  that  each  cut-point  should  have  an  associated  standard  eirror 
routinely  computed  as  part  of  the  stamdard  setting  process  (Bobko  & 
Wise,  1987) .  Second,  Shepard  (1980)  distinguishes  between  two  types  of 
standards:  an  "individual  diagnosis"  standard  vrtiich  is  focused  on 
improvement,  and  an  "individual  certification"  standard  which  "renders 
a  final  judgment  of  quality"  (p.  449) .  This  distinction  is  consistent 
with  our  above  notion  that  standards  can  be  used  for  either 
motivational  or  evaluative  purposes. 


Goal  Setting 

Empirical  findings  in  the  goal  setting  literature  are  relevant  to 
the  extent  that  performance  standards  have  motivational  value.  The 
basic  premise  underlying  goal  setting  theory  is  that  an  individual's 
personal  goals  are  the  immediate  (although,  not  only)  regulator  of  his 
or  her  actions  (Locke  &  Latham,  1990).  Over  the  past  25  years,  an 
abundance  of  research  has  been  conducted  in  both  laboratory  and  field 
settings  which  tests  and  develops  the  conditions,  mediating  mechanisms, 
and  limits  of  goal  setting  theory.  Numerous  reviews  and  meta-analyses 
have  been  conducted  on  these  empirical  studies,  the  most  recent  and 
comprehensive  being  that  of  Locke  and  Latham  (1990).  In  order  to  avoid 
repetition,  this  section  of  the  paper  simply  points  out  those  findings 
which  appear  to  be  most  robust  and  consistent  across  studies.  The  major 
focus  of  this  section  is  to  draw  the  connection  between  performance 
standards  and  one's  personal  goals  and  then  to  illustrate  how 
standards,  through  their  influence  on  pjersonal  goals,  can  affect  the 
motivation  to  perform  and,  consequently,  performance. 

Locke  and  Latham  (1990)  provide  an  in-depth  discussion  of  the 
differences  and  similarities  between  terms  such  as  intention,  norm, 
purpose,  level  of  aspiration,  goal,  and  standard.  Our  current  review  is 
concerned  with  issues  involved  in  setting  external  standards  (i.e.,  the 
performance  levels  specified  by  the  organization,  to  individuals,  which 
are  necessary  to  achieve  a  designated  level  of  performance) .  On  the 
other  hand,  goal  setting  theorj  primarily  focuses  on  the  personal  goals 
held  by  an  individual  (i.e.,  the  internal  goal  which  an  individual  is 
striving  to  achieve) . 

There  are  two  general  findings  in  the  goal  setting  literature 
which  have  been  extensively  studied  and  consistently  supported  (Locke  S 
Latham,  1990) .  First,  subjects  who  work  towards  difficult,  specific 
goals  perform  better  than  those  who  work  toward  easy,  vague,  or  no 
goals.  Second,  performance  tends  to  increase  linearly  with  goal 
difficulty.  Goal  setting  has  been  proposed  and  found  in  many  cases  to 
have  positive  effects  on  performance  through  the  following  motivational 
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mechanisms;  behavioral  direction  (e.g..  Organ,  1977;  Rothkopf  & 
Billington,  1975),  effort  (e.g.,  Bandura  &  Cervone,  1983,  1986;  Bryan  & 
Locke,  1967a,  1967b;  Campion  &  Lord,  1982),  persistence  (e.g.,  Bavelas 
&  Lee,  1978),  and  task  specific  strategies  (Earley  &  Perry,  1987; 
Terborg,  1976) . 

In  order  for  external  standards  to  have  a  positive  influence  on 
motivation  through  the  goal  setting  process,  externally  defined 
standards  must  be  translated  by  the  individual  into  personal  goals 
which  are  specific  and  difficult.  This  situation  is  similar  to  one  in 
which  subjects  are  assigned  goals  vdiich  then  are  either  translated  into 
personal  goals  or  rejected. 

The  literature  most  releveint  to  the  issue  of  the  treinslation  of 
assigned  goals  into  personal  goals  is  that  on  commitment  to  assigned 
goals.  Both  Locke  and  Lathaim  (1990)  and  Hollenbeck  and  Klein  (1987) 
have  reviewed  this  literatxire  auid  developed  summaries  of  the  conditions 
under  which  individuals  will  be  committed  to  assigned  goals.  These  are 
presented  in  Figure  2.  It  should  be  noted  that  many  of  these  conditions 
have  been  empirically  examined  and  supported  (e.g.,  rewards  [Latham, 
Mitchell,  &  Dossett,  1978;  Pritchard  and  Curtis,  1973],  peer  influence 
[Earley  &  Kanfer,  1985;  Matsui,  Kakuyeima,  &  Onglatco,  1987],  and 
conflict  [Erez,  Earley,  &  Hulin,  1985;  Latham,  Erez,  &  Locke,  1988]) 
while  others  have  not  received  much  empirical  attention  (e.g.,  ego 
involvement  and  goal  intensity) . 

One  important  dimension  on  which  external  standards  and  assigned 
goals  differ  is  that  some  organizations  use  external  standards  to 
define  minimally  acceptable  performance  (although  individuals  may  try 
to  perform  beyond  the  "standard”).  On  the  other  hand,  assigned  goals, 
as  usually  presented  in  goal  setting  theory,  reflect  the  level  of 
performance  that  external  sources  intend  individuals  to  try  to  achieve. 
This  distinction  raises  the  question,  "When  will  an  individual  come  to 
interpret  a  performance  standard  as  if  it  was  a  personal  goal?"  If  some 
of  the  conditions  in  Figure  2  are  present  when  a  standard  is  set  (e.g., 
the  standard  is  set  by  a  respected  authority  figure,  it  is  tied  to 
rewards  and/or  punishment,  and  it  is  public) ,  will  individuals  adopt 
the  standard  as  their  own  maximal  performance  goal  to  the  extent  that 
they  will  not  be  motivated  to  go  beyond  that  particular  level  of 
performance?  This  issue  deserves  empirical  investigation. 

Thus,  if  the  organization  decides  to  use  standards  as  a  way  of 
increasing  performance  (rather  than  insuring  a  minimal  level  of 
performance) ,  then  care  must  be  taken  that  performance  standards  are 
sufficiently  difficult  and  specific  eind  that  conditions  exist  which 
will  lead  to  commitment.  On  the  other  hand,  if  the  organization  sets 
standards  without  considering  their  possible  translation  into 
individual  performance  goals,  individuals  may  adopt  minimal  level 
standards  as  their  personal  goals,  and  consequently  both  motivation  and 
subsequent  performance  may  be  lower  than  had  more  difficult  personal 
goals  been  set. 


*  Goals  are  assigned  by  authority  figures  who  are  . . . 

-  seen  as  legitimate 

-  physically  present 

-  supportive 

-  trustworthy 

-  provide  a  rationale  for  goals 

-  exert  reasoncible  pressure 

-  are  knowledgeeible  and  likeeible 

*  Assigned  goals 

-  imply  rewards  and  punishments 

-  convey  positive  self-efficacy  information 

-  foster  a  sense  of  achievement 

-  imply  opportunities  for  self-improvement 

-  are  challenging 

-  are  public 

-  have  high  instrumentality  and  valence 

-  are  made  for  ego  involving  tasks 

-  do  not  conflict  with  other  goals 

-  have  a  high  expectancy  for  success 

-  are  intense 

Figure  2.  Factors  increasing  commitment  to  assigned  goals. 


Related  to  the  goal  setting  literature  is  the  management  by 
objectives  (MBO)  literature,  which  concerns  the  application  of  goal 
setting  theory  on  an  organization-wide  basis.  In  theory,  MBO  programs 
begin  at  the  top  of  an  organization,  whereby  top  management  sets 
organizational  goals  and  objectives.  These  objectives  are  then  filtered 
(cascaded)  downward  in  a  performance  evaluation  system  where  managers 
meet  with  their  subordinates  to  develop  individual  objectives  and 
plans.  These  objectives  should  follow  from  the  goals  and  objectives 
specified  at  higher  levels.  Although  the  idea  of  MBO  (Drucker,  1954) 
was  postulated  long  before  goal  setting  research,  the  positive  effects 
of  MBO  can  be  mainly  attributed  to  goal  setting  theory  (cf.  Tosi, 

Rizzo,  &  Carroll,  1990). 

One  feature  of  MBO  systems  relevant  to  the  setting  of  performance 
standards,  and  not  clarified  in  the  empirical  research  on  goal  setting 
theory,  is  its  focus  on  employee  participation  and  commitment  by  top 
management.  By  definition,  MBO  requires  employee  participation  in  the 
setting  of  objectives  (Griffin,  1990).  Furidiermore ,  top  management's 
participation  and  commitment  to  the  MBO  program  has  been  found  to  be  a 
crucial  determinant  to  the  progreim's  success  in  increasing  motivation 
and  performance  (Carroll  &  Tosi,  1973;  Rodgers  &  Hunter,  1986).  This 
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implies  that  participation  in  standard  setting  procedures  by  both  top 
management  and  those  to  whom  the  standards  apply  should  increase  the 
overall  motivating  potential  of  the  resulting  standards. 


Performance  Appraisal 

Although  the  procedures,  processes,  and  methods  of  performance 
appraisal  have  been  the  subject  of  much  empirical  and  theoretical 
study,  little  of  this  work  has  centered  on  the  role  of  external 
performance  standards  in  the  performance  appraisal  process.  While  there 
have  been  many  recent  reviews  of  the  performemce  appraisal  literature 
(DeNisi,  Cafferty,  &  Meglino,  1984;  Feldman,  1981;  Ilgen  &  Feldman, 

1983;  Landy  &  Farr,  1980;  Murphy  &  Cleveland,  1991;  Smith,  1976;  Wexley 
&  Klimoski,  1984),  only  the  Murphy  and  Cleveland  (1991)  review  has 
examined  performance  standards  closely.  Indeed,  these  authors  concede 
that  the  topic  of  performance  standards  has  not  been  given  sufficient 
attention  in  the  performemce  appraisal  literature. 

There  are  two  roles  that  external  performance  standards  play  in 
the  performance  appraisal  process.  The  first  is  the  manner  in  which 
external  standards  influence  how  raters  rate  people.  The  second 
concerns  the  impact  of  standards  on  feedback  and  how  people  react  to 
feedback.  This  section  of  the  review  focuses  on  the  first  issue.  The 
impact  of  standards  on  the  feedback  process  is  reviewed  in  the  next 
section. 

Murphy  and  Cleveland  (1991)  describe  the  performance 
appraisal/ judgment  process  as  one  in  which  raters  compare  their 
perceptions  of  a  ratee's  behavior  to  their  own,  internal  standards, 
resulting  in  an  evaluation.  Again,  as  in  the  goal  setting  literature,  a 
distinction  needs  to  be  made  between  internal  (on  the  part  of  raters) 
and  external  performance  standards.  External  performance  standards  can 
influence  ratings  by  influencing  any  of  the  following  components  of  the 
performance  appraisal  process:  1)  a  rater's  perception  of  ratee 
behavior;  2)  the  rater's  internal  performance  standards;  and  3)  the 
evaluation  process. 

The  existence  of  standards  can  influence  perceptions  of  ratee 
behavior  by  focusing  raters'  attention  on  certain  aspects  of 
performance  over  others.  Standards  can  define  which  behaviors  are 
important,  unacceptable,  desireible,  etc.,  and  thus  define  which 
behaviors  have  evaluative  implications.  Research  has  shown  that 
behaviors  which  have  strong  evaluative  implications  are  likely  to 
receive  attention  (Murphy,  1982;  Wegner  &  Vallecher,  1977).  Therefore, 
explicit  performance  standards  may  have  a  beneficial  impact  on  the 
rating  process  by  drawing  raters'  attention  to  those  aspects  of 
performance  explicitly  defined  as  important  by  the  organization.  On  the 
other  hand,  explicit  standards  may  lead  raters  to  ignore  aspects  of 
performance,  which  although  important  to  effectiveness,  are  not 
specified  in  standards  (Murphy  &  Cleveland,  1991) . 
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Standards  may  also  influence  raters'  perceptions  of  performamce  by 
influencing  how  performance  information  is  cognitively  encoded, 
retained,  and  retrieved.  Performance  appraisal  research  has 
consistently  pointed  out  that  the  manner  in  which  raters  cognitively 
categorize  and  encode  information  has  ein  important  impact  on  how  that 
information  is  subsequently  used  in  making  performance  judgments 
(Mvirphy  &  Clevelamd,  1991) .  DeNisi  and  Feldmcin,  along  with  their 
colleagues  (DeNisi,  Cafferty,  &  Meglino,  1984;  DeNisi  &  Williams,  1988; 
Feldman,  1981;  Ilgen  &  Feldmam,  1983),  have  developed  models  of  the 
performance  appraisal  process  v^ich  borrow  heavily  upon  the  social 
cognition  literature  concerning  person  perception. 

One  main  feature  of  this  work  has  been  to  examine  how  people 
categorize  information  about  others'  performance  (Borman,  1987;  Nathan 
&  Lord,  1983).  Wyer  auid  Srull  (1986)  have  suggested  that  category 
accessibility  is  an  important  factor  in  determining  how  individuals 
categorize  information.  It  may  be  that  externally  set  standards  help  in 
defining  the  performcince  categories  held  by  individuals  and  make 
certain  categories  more  accessible  through  priming.  However,  little 
research  has  been  done  on  the  content  of  raters'  performance  categories 
(Murphy  &  Clevelcind,  1991)  .  For  example,  we  really  don't  know  what  type 
of  information  is  contained  in  one's  "good  worker"  category  or  how  such 
categories  develop  over  time.  Thus  the  impact  of  external  performance 
standards  on  the  content  and  development  of  raters'  cognitive 
performance  categories  is  in  prime  need  of  investigation. 

The  second  way  in  which  standards  can  influence  performance 
judgments  is  by  influencing  raters'  internal  performance  standards, 
used  as  a  comparison  for  perceived  behaviors.  Clearly,  this  issue 
relates  to  how  external  standards  influence  raters'  cognitive 
categories  of  performance.  Murphy  and  Cleveland  (1991)  have  also 
hypothesized  that  the  degree  to  which  external  performance  standards 
get  translated  into  internal  performance  standards  depends  on  the 
rater's  identification  with  and  commitment  to  the  goals  of  the 
organization. 

Finally,  performance  standards  may  affect  ratings  by  influencing 
the  evaluation  process.  This  may  occur  because  providing  explicit 
performance  standards  can  reduce  the  amount  of  bias  in  ratings  due  to 
extraneous  factors  (e.g.,  gender,  handicap  status).  It  has  been  argued 
that  when  raters  are  given  specific  pjerformance  related  information  (in 
this  case  performance  standards) ,  the  amount  of  variance  in  their 
ratings  due  to  bias  or  rating  error  will  be  reduced  (Czajka  &  DeNisi, 
1988;  Terborg,  1977).  Two  laboratory  studies  which  directly  examined 
the  impact  of  specific  performance  standards  on  raters'  judgments  had 
differing  results.  Huber,  Neale,  and  Northcraft  (1987)  found  that 
performance  standards  did  not  impact  on  managers'  judgments  of 
performance,  compensation,  training,  and  promotion.  In  this  case,  the 
performance  level  of  employees  (described  on  paper)  had  the  most  impact 
on  ratings.  On  the  other  hand,  Czajka  and  DeNisi  (1988)  found  that 
providing  subjects  with  specific  performance  standards  reduced  the  bias 
in  their  performance  ratings  of  emotionally  disabled  ratees  (described 
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using  videotape) .  Clearly  this  issue  is  in  need  of  further  research. 


Feedback 

However  performance  standards  are  used,  an  evaluation  of 
performance  (relative  to  the  set  standard)  needs  to  be  fed  back  to  the 
individual  worker  and  relevant  decision  makers.  Research  has 
demonstrated  that,  in  general,  providing  people  with  feedback  eibout 
their  performance  will  have  a  positive  effect  on  their  future 
performance  (Guzzo,  Jette,  &  Katzell,  1985;  Ilgen,  Fisher,  &  Taylor, 
1979;  Kopelman,  1986). 

However,  before  feedback  can  have  an  effect  on  performance,  people 
must  perceive,  accept,  and  respond  to  feedback  (Ilgen  et  al.,  1979). 
External  performcince  standards  can  have  profound  effects  on  any  of 
these  processes  (Taylor,  Fisher,  &  Ilgen,  1983).  There  is  empirical 
research  which  has  exzunined  the  attributes  of  feedback  and  their 
effects  on  employee  reactions  and  behavior  (Guzzo  et  al.,  1985;  Ilgen 
et  al.,  1979).  However,  little  empirical  work  has  directly  examined  how 
performance  standards  enter  into  the  feedback  process. 

Taylor  et  al.  (1983)  have  developed  a  model  to  explain  how 
individuals  react  to  feedback.  Their  model  is  based  on  control  theory 
(Carver  &  Scheier,  1981;  Powers,  1973)  which  states  that  reactions  to 
feedback  result  from  a  comparison  process  in  which  perceived  feedback 
is  compared  to  internal  performance  standards.  Based  on  this  model, 
external  performance  standards  might  play  two  important  roles  in  the 
feedback  loop.  The  first  (already  mentioned  in  the  previous  section) 
deals  with  how  individuals  translate  external  performance  standards 
into  internal  performance  standards.  The  second  issue  is  the  effect 
that  external  performance  standards  have  on  the  comparison  process  and 
resulting  response. 

Due  to  the  cimount  of  role  conflict  eind  ambiguity  often  reported  by 
employees,  especially  new  employees  (French  &  Caplan,  1973;  Katz  & 

Kahn,  1978) ,  the  importance  of  setting  standards  which  will  be 
internalized  is  clear.  The  literature  on  organizational  entry  (Wanous, 
1980;  Wanous  &  Colella,  1989)  emphasizes  the  importance  of  providing 
organizational  newcomers  with  specific,  honest,  and  clear  cut 
information.  Whether  this  information  (including  performance  standards) 
becomes  internalized  depends  to  a  large  part  upon  the  socialization 
process  (Van  Maanen  &  Schein,  1979)  and  the  degree  to  which  standards 
are  valu^  by  individuals  (Taylor  et  al.,  1983).  Thus,  three  important 
factors  to  consider  when  setting  standards  are  (i)  the  clarity  of  the 
standard,  (ii)  how  adequately  information  about  the  standard  is 
disseminated,  and  (iii)  how  important  the  standard  is  likely  to  be  to 
employees. 

Once  external  performance  standards  have  been  internalized, 
individuals  must  compare  their  feedback  to  these  standards.  There  are 
two  attributes  of  standards  which  may  lead  to  frequent  comparisons;  1) 
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vrtien  employees  are  iinsure  about  their  ability  to  meet  standards  (Taylor 
et  al.,  1983;  Weiss,  Ilgen,  &  Sharbaugh,  1982),  and  2)  when  standards 
are  valued  (Ashford  &  Cummings,  1982;  Taylor  et  al.,  1983).  Therefore, 
in  order  to  increase  the  frequency  with  which  employees  compare 
feedback  to  performance  standards,  the  internalized  standards  should  be 
both  difficult  and  rewarding.  [Although  beyond  the  scope  of  this 
review,  C.  Walker  (personal  communication,  July  23,  1991)  has  noted 
that  the  concept  "difficulty”  can  be  defined  along  many  dimensions.  For 
example,  difficulty  can  be  increased  by  reducing  time  to  task 
completion,  extending  cognitive  ability  requirements,  increasing 
endurance  requirements,  or  increasing  the  need  for  dependence  on  co¬ 
worker  performcince.  Future  research  is  needed  to  investigate  whether 
these  dimensions  moderate  the  effects  of  goal  difficulty.] 

Once  a  comparison  is  made,  individuals  may  react  in  several  ways 
to  feedback  (see  Taylor  et  al.,  1983,  for  a  review).  Taylor  et  al. 
distinguish  between  cognitive,  behavioral,  and  affective  reactions, 
listed  in  Figure  3.  Individual  reactions  are  a  function  of  many  factors 
(e.g.,  peer  influence,  individual  differences),  but  the  focus  here  is 
on  how  external  performance  standards  may  influence  reactions. 


Cognitive 

*  Assessment  of  Feedback  Accuracy 

*  Evaluation  of  Feedback  Source  Credibility 

*  Evaluation  of  System  Fairness 

*  Adjustment  of  Expectancies  for  Standard  Attainment 

*  Adjustment  of  Internal  Behavioral  Standards 

Behavioral 

*  Changing  Direction  of  Behavior 

*  Altering  Effort 

*  Persisting  versus  Quitting 

*  Responding  Against  the  Feedback  System 

Affective 

*  General  Job  Satisfaction 

*  Satisfaction  with  Appraisal  System 

Figure  3 .  Reactions  to  feedback 


One  attribute  of  external  standards  likely  to  influence  feedback 
reactions  is  the  level  of  difficulty  of  the  performance  standard.  From 
a  control  theory  perspective  (and  congruent  with  goal  setting  theory')  , 
increases  in  motivation  (i.e.,  direction,  intensity,  or  persistence  of 
behavior)  will  likely  result  when  feedback  indicates  that  people  have 
performed  below  standards,  thus  supporting  the  notion  that  standards 
should  be  difficult  (Campion  &  Lord,  1982;  Taylor  et  al,,  1983).  If 
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external  standards  are  easily  attained,  and  no  reward  is  provided  for 
exceeding  standards,  then  people  may  actually  lower  their  internal 
standards  and  motivation  (Janz,  1982;  Taylor  et  al.,  1983).  On  the 
other  hand,  if  standards  remain  too  difficult,  subjects  may  lower  their 
expectcincy  of  success  to  the  point  where  they  just  give  up  (Carver  & 
Scheier,  1981)  or  lower  their  own  internal  standards  (Caution  &  Lord, 

1982) .  Extremely  high  standards  may  also  cause  individuals  to  perceive 
the  feedback  system  as  unfair  euid  not  credible  (Oombusch  &  Scott, 

1975) .  Further,  since  a  primary  influence  on  affective  reactions  to 
feedback  is  the  sign  of  feedback  (Ilgen  et  al.,  1983;  Taylor  et  al., 

1983) ,  unrealistically  difficult  standards,  to  the  extent  that  they 
result  in  negative  feedback,  will  lead  to  negative  affect. 

Another  influential  attribute  of  performance  standards  might  be 
the  specific  content  of  the  standards.  Research  on  feedback  has 
demonstrated  that  specific,  descriptive  feedback,  compared  to 
evaluative  outcome  feedback,  results  in  more  accurate  evaluations  of 
expectcincy  for  success  (Taylor  et  al.,  1983),  leads  to  perceptions  of 
source  credibility  and  system  fairness  (Dornbusch  &  Scott,  1975; 

Jacobs,  Jacobs,  Feldman,  &  Cavior,  1973),  and  increases  performance  by 
allowing  people  to  make  accurate  attributions  about  past  performance 
(Carver  &  Scheier,  1981) .  Standards  which  are  clear,  descriptive,  and 
specific,  and  consequently  allow  for  feedback  along  these  dimensions, 
should  produce  more  desirable  responses. 

Finally,  the  issue  of  who  sets  performance  standards  may  be 
important  in  determining  reactions  to  feedback.  Typically,  research  on 
standard  setting  has  focused  on  how  judges  or  subject  matter  experts 
set  standards.  Allowing  those  to  whom  the  standards  will  be  applied  to 
participate  in  the  standard  setting  process  may  be  beneficial  for 
several  reasons.  First,  employees  will  be  more  likely  to  perceive 
standards  as  fair  (Taylor  et  al.,  1983).  Second,  employees  may  be  more 
committed  to  reaching  the  performance  stemdards  and  more  likely  to 
internalize  them  (Erez  &  Kanfer,  1983) .  Third,  reactions  against  the 
system  may  be  less  likely  (Dornbusch  &  Scott,  1975) . 

The  framing  of  performance  information.  The  framing  of  performance 
information  is  also  critical  to  the  feedback  process.  Decision  making 
research  has  demonstrated  that  individuals  process  information 
differently  depending  upon  whether  the  information  is  framed  in  terms 
of  positive  outcomes  or  negative  outcomes  (e.g.,  are  performance 
standards  set  in  terms  of  "success  rates"  or  "failure  rates"?) .  For 
exeumple,  according  to  Kahneman  and  Tversky's  (1979)  "prospect  theory", 
judges  are  risk-seeking  when  confronted  with  information  in  terms  of 
potential  loss,  but  risk-averse  when  faced  with  information  in  terms  of 
potential  gain.  The  impact  of  frame  occurs  even  when  the  possible 
outcomes  of  the  negatively  and  positively  framed  problems  are 
mathematically  identical.  This  has  been  illustrated  by  Tversky  and 
Kahneman 's  (1981)  "epidemic  problem"  where,  in  response  to  an  imminent 
epidemic,  subjects  were  found  to  select  a  risky  option  when  the  outcome 
was  expressed  in  terms  of  lives  lost,  but  a  more  certain  option  when 
the  identical  outcome  was  expressed  in  terms  of  lives  saved. 


Bazerman  (1983)  has  suggested  that  the  framing  of  information  is 
one  of  the  crucial  factors  vrtiich  affect  policymaker  judgments.  Indeed, 
Bobko,  Shetzer,  and  Russell  (1991)  demonstrated  that  positive  and 
negative  frames  cleeurly  affected  judgments  about  the  perceived  worth  of 
work  performance.  Further,  the  existence  of  framing  effects  has  been 
noted  at  the  group  level  of  behavior  (Schurr,  1987).  Thus,  since 
standards  are  value  judgments,  policymaker  judgments  about  levels  for 
standards  are  predicted  to  be  affected  by  whether  or  not  the  stemdards 
are  stated  in  positive  or  negative  ways.  Further,  even  if  there  is 
agreement  about  the  level  of  a  standard,  it  may  be  that  individuals 
receiving  performance  feedback  in  relation  to  existing  standards  will 
react  differently  depending  upon  how  the  feedback  is  framed  (e.g. ,  ’’you 
achieved  80%  of  the  standaurd”  versus  "you  failed  to  achieve  20%  of  the 
standard”) . 


Related  Issues  in  Utility  Analysis  and  Performance  Effectiveness 


The  appropriate  level  of  difficulty  for  performance  stamdards  can 
also  be  informed  by  a  review  of  utility  analysis  —  which  has  recently 
focused  on  judgjnental  procedures  for  assessing  the  effectiveness  (or 
overall  worth)  of  paurticular  levels  of  individual  performance.  There 
has  been  a  resurgence  of  interest  in  determining  the  utility  of 
selection  instruments  and  organizational  interventions  (Bobko,  Karren, 

&  Kerkar,  1987;  Boudreau,  1991;  Vance  &  Colella,  I990b) .  Computations 
of  utility  are  based  upon  decision  theoretic  equations  developed  by 
Cronbach  and  Gleser  (1965).  In  computing  utility,  the  standard 
deviation  of  performance  worth,  SDy,  is  a  focal  parameter.  Knowledge 
about  estimates  of  SDy  are  critical  here  because  they  usually  involve 
the  subjective  estimation  of  the  worth  of  peurticular  work  performance 
levels  (cf.  Bobko  et  al.,  1987,  for  a  review  of  SDy  estimation). 

For  example,  a  number  of  studies  (Bu’-ke  &  Frederick,  1984;  Karren 
&  Bobko,  1983;  Mathieu  &  Tannenbaum,  1985;  Weekly,  Frank,  O'Connor,  & 
Peters,  1985)  have  reported  negative  estimates  of  worth  (for  individual 
performance  at  15th  percentiles)  even  though  the  judgment  task  had 
explicit  demand  characteristics  to  give  positive  values.  Subsequently, 
Sadacca,  Campbell,  DiFazio,  Schultz,  and  White  (1990)  explicitly  gave 
subjects  both  positive  and  negative  scale  anchors  in  order  to  obtain 
better  psychometric  properties  for  judgments  of  performamce  worth.  The 
point  here  is  that  negative  and  positive  effectiveness  ratings  imply 
the  possibility  of  a  "zero-point”  in  the  utility  curve.  Such  a  point 
would  be  a  natural  estimate  for  a  "minimum”  performance  standard  when 
standards  are  used  as  evaluative  devices. 

Further,  Pritchard,  Jones,  Roth,  Stuebing,  and  Ekeberg  (1988)  have 
extended  the  notion  of  negative  performance  utility  estimates  by 
explicitly  mapping  the  entire  range  of  performance  effectiveness.  That 
is,  they  generate  "contingency  curves"  where  the  horizontal,  X-axis  is 
an  increasing  scale  of  performance  on  a  criterion  and  the  Y-axis  is  a 


measure  (in  ratio  scale)  of  the  estimated  effectiveness  of  that 
performance  to  the  organization,  ranging  from  -100  to  +100.  It  should 
be  noted  that  Pritchard  et  al.'s  curves  also  cross  the  "zero-point"  of 
effectiveness,  so  that  some  minimum  stemdard  might  be  identified. 
Additionally,  the  effectiveness  curves  they  generate  are  not  usually 
linear:  some  reinges  of  performamce  show  large  changes  in  effectiveness 
(large  slope) ,  while  other  performance  ranges  are  associated  with 
"flat"  effectiveness  cnarves.  Thus,  the  contingency  curves  often  look 
like  step  functions  (see  Figure  4,  to  be  discussed  later).  It  may  be 
that  the  points  at  which  the  steps  change  slope  are  good  csmdidates  for 
different  levels  of  performance  standards- 

It  has  also  been  suggested  that  different  organizational 
environments  can  effect  beliefs  amd  values  about  the  perceived 
effectiveness  of  work  behaviors  (e.g.,  utility  values  may  change  across 
hostile  environments,  benign  environments,  after  the  introduction  of 
new  technologies,  after  a  union  vote;  see  Bobko  et  al.,  1987).  Again, 
because  they  are  value-driven,  standards  may  also  be  affected  by  these 
environmental  factors.  Indeed,  it  is  common  folklore  that  organizations 
will  "lower  their  standards"  to  meet  leibor  market  conditions  (see 
Carlson,  1967,  for  an  empirical  verification) . 

The  metric  in  which  utility  analyses  are  reported  has  also 
received  some  theoretical  attention.  Typically,  utility  is  assessed  in 
dollar  terms,  although  recent  reviews  (Bobko  et  al.  1987;  Vance  & 
Colella,  1990b)  have  concluded  that  other  metrics,  specific  to 
organizational  needs,  are  more  useful  to  decision  makers.  For  example, 
both  Eaton,  Wing,  amd  Mitchell  (1985)  emd  Sadacca  et  al.  (1990) 
developed  metrics  in  terms  of  hypothetical  individuals  (e.g. ,  perhaps  5 
superior  people  are  worth  the  same  as  8  average,  50th  percentile, 
individuals) .  On  the  other  hand,  the  work  of  Pritchard  et  al.  (1988) 
finesses  the  metric  problem  by  assessing  utility  in  terms  of  an 
cibstract  effectiveness  scale  ranging  from  -100  to  +100.  It  should  be 
clear  that  performance  utility  (and,  hence,  how  we  conceive  of 
performance  standards)  can  be  approached  in  many  formats,  such  as  an 
abstract  value,  a  subjective  rating  along  some  criterion  dimension, 
measured  output  (quantity  of  production,  production  value) ,  or 
hypothetical  individuals  (i.e.,  some  sort  of  prototypic  individual, 
ranging  from  minimally  qualified  to  outstanding) . 


Job  Satisfaction 


There  has  been  a  plethora  of  researcn  concen  ing  employees' 
affective  reactions  to  jobs.  We  focus  on  job  satisfaction,  because  it 
is  clearly  the  most  researched  affective  reaction  and  generally 
correlates  highly  with  organizational  withdrawal  behaviors.  For 
example,  meta-analyses  have  found  that  job  satisfaction  has  a  mean 
correlation  of  -.29  with  absenteeism  (Scott  &  Taylor,  1985)  and  -.23 
with  turnover  (Carsten  &  Spector,  1987).  Also,  those  aspects  of 
standard  setting  most  likely  to  influence  job  satisfaction  should  also 
have  similar  effects  on  other  affective  reactions  such  as 
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organizational  commitment.  Several  models  exist  which  attempt  to 
explain  job  satisfaction  (Hulin,  Roznowski,  &  Hachiya,  1985;  March  & 
Simon,  1958;  Smith,  Kendall,  &  Hulin,  1969;  Thibaut  &  Kelley,  1959) .  A 
review  of  this  literatuare  is  clearly  beyond  the  scope  of  this  paper 
(see  Hulin,  1991,  for  the  roost  recent  review) .  For  our  purposes,  only 
'^ose  areas  of  the  literatxire  which  appear  relevant  to  the  issue  of 
setting  performance  standeirds  will  be  reviewed. 

Discrepancy  theories  have  been  a  popular  approach  to  explaining  or 
predicting  job  satisfaction.  In  general  these  theories  (e.g.,  Lawler, 
1973;  Locke,  1976;  Lofquist  &  Dawis,  1969;  Porter  &  Steers,  1973;  and 
Smith  et  al.,  1969)  state  that  it  is  the  discrepancy  between  one's 
current  perception  of  job  characteristics  or  experiences  and  some 
internal  coirparison  standard  vdiich,  in  part,  explains  job  satisfaction. 
The  presumed  dimensions  of  compaurison  vary  across  researchers.  For 
excunple,  Porter  and  Steers  (1973)  focvised  on  the  discrepancy  between 
what  one  perceives  to  have  amd  v^at  one  expects  to  get,  while  Locke 
(1976)  focused  on  the  discrepaincy  between  what  one  perceives  to  have 
and  what  one  wants  to  have.  Empirical  reseairch  has  generally  supported 
discrepancy  theories  of  job  satisfaction  (Michalos,  1986;  Wanous, 

Poland,  Premack,  &  Davis,  1991). 

Probably  the  most  critical  dimension  of  performance  standards  in 
influencing  satisfaction  is  the  individual's  probability  of 
successfully  meeting  or  exceeding  existing  standards.  Research  has 
demonstrated  that  there  is  a  strong  relationship  between  successful 
task  performance  and  job  satisfaction  (see  Locke  &  Latham,  1990,  for  a 
review) .  Thus,  in  order  to  facilitate  satisfaction,  standards  should  be 
set  at  a  difficulty  level  which  makes  success  probable. 

Another  dimension  of  performance  standards  which  can  affect  job 
satisfaction  concerns  the  particular  rewards  which  aure  linked  to 
standeird  attainment.  According  to  the  Hulin  et  al.  (1985)  model  of  job 
satisfaction,  the  outcomes  (e.g.,  salairy,  fringe  benefits,  status, 
working  conditions,  intrinsic  outcomes)  received  from  meeting  a 
standard  should  be  favorably  compeired  to  the  inputs  (e.g.,  skills, 
time,  effort,  training)  involved  in  performing  to  meet  the  standard. 

The  specification  of  particular  outcomes  is  beyond  the  scope  of  this 
paper,  and  furthermore,  this  is  an  issue  which  is  heavily  influenced  by 
specific  organizational  goals.  However,  one  important  intrinsic  reward, 
a  sense  of  achievement,  needs  to  be  mentioned  since  it  directly  bears 
on  the  issue  of  standeird  difficulty.  In  the  preceding  peuragraph  it  was 
postulated  that  standards  should  be  easy  enough  so  that  success  is 
likely.  However,  reseeirch  has  shown  that  meeting  or  exceeding 
difficult  and  challenging  standards  will  lead  to  a  sense  of  achievement 
not  found  when  meeting  easy  standeurds  (Locke  &  Latham,  1990) .  Thus, 
standard  difficulty  should  be  set  at  a  level  which,  when  met,  will  be 
intrinsically  rewarding,  as  well. 

A  third,  related  aspect  of  standards  which  can  influence 
satisfaction  is  the  degree  to  which  success  in  meeting  the  standard  can 
be  attributed  to  one's  personal  ability.  That  is,  satisfaction  with 
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performance  has  been  found  to  be  greater  when  individuals  can  attribute 
success  to  personal  qualifications  or  abilities  rather  than  to  luck, 
chance,  or  the  easiness  of  the  task  (Weiner,  1986) .  Thus,  standards 
^rtiich  reflect  aspects  of  job  performance  which  are  under  the  control  of 
the  individual  (e.g.,  the  nximber  of  calls  made  in  the  case  of  a  phone 
salesperson)  should  have  more  positive  effects  on  satisfaction  than 
those  aspects  of  performance  which  are  influenced  by  extraneous  factors 
(e.g.,  the  number  of  actual  sales). 

Fourth,  the  perceived  rationale  for  a  given  standard  can  influence 
satisfaction.  Phillips  and  Freedman  (1988)  found  that  students  who  were 
given  a  reasonable  explanation  for  an  assigned  goal  experienced  more 
satisfaction  than  those  who  were  given  no  reason.  Perhaps  participation 
in  the  standard  setting  process  is  one  mechanism  through  which 
employees  can  come  to  understand  the  rationale  behind  given  performance 
standards . 

Finally,  it  has  been  demonstrated  that  people  consider  their  past 
performance  when  judging  their  current  performcuice  (Simon,  1988;  Vance 
&  Colella,  1990a)  and  that  satisfaction  may  be  enhcinced  when  feedback 
is  presented  in  terms  of  changes  (i.e.,  improvements)  in  performance. 
The  implication  for  standard  setting  is  that  standards  which  are 
defined  in  terms  of  performance  improvements  may  facilitate 
satisfaction. 


IDENTIFICATION  OF  FUTURE  RESEARCH  NEEDS 


All  organizations  set  and  communicate  performance  standards, 
implicitly  or  explicitly.  While  there  is  scant  organizational  research 
on  how  this  is  best  accomplished,  we  have  reviewed  related  literatures 
which  focus  on  the  appraisal,  feedback,  and  valuation  of  performance. 
Based  on  these  literatures,  we  identify  four  domains  where  both  basic 
and  applied  research  on  performance  standards  are  clearly  needed.  Such 
research  is  necessary  if  we  are  to  better  employ  performance  standards 
to  both  evaluate  and  motivate  employees.  Specific  hypotheses  are  also 
stated  when  possible.  The  four  general  topic  areas  are: 

1)  The  internalization  of  external  performance  standards 

2)  The  definitional  content  of  performance  standards 

3)  The  communication  of  performance  standards 

4)  The  difficulty  of  performance  standards 


Translating  External  Standards  Into  Internalized  Standards 

The  goal  setting,  performance  appraisal,  and  feedback  literatures 
reviewed  above  all  point  to  the  importance  of  the  translation  of 
external  performance  standards  into  internalized  performance  standards. 
This  translation  seems  so  fundamental  to  the  efficacy  of  setting 
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performance  steuidards,  yet  there  is  no  direct  literature  which  verifies 
the  linkage.  We  hypothesize  that: 


Hypothesis  1:  Individual  reactions  (both  motivational 
and  affective)  to  standards  depends  on  the  degree  to 
ndiich  external  performance  standards  are  internalized  by 
both  those  %dio  apply  the  standards  and  those  to  \diam  the 
standards  apply. 

Our  review  turned  up  several  hypotheses  about  conditions  under 
which  internalization  is  most  likely  to  occur.  First,  Murphy  and 
Cleveland  (1991)  made  the  following  hypothesis; 

Hypothesis  2:  Ihe  degree  to  %diich  extemaLL  performance 
standards  are  intem£d.ized  depends  on  the  degree  to 
vAiich  the  employee  identifies  with,  and  is  committed  to, 
the  goals  of  the  organization. 

Thus,  one  objective  in  setting  standards  is  to  develop  standards 
which  are  likely  to  build  upon  an  individual's  orgeinizational 
commitment  (and/or  reason  for  joining  the  organization  in  the  first 
place) .  The  goal  setting  literature  has  discussed  this  issue  in  great 
detail,  and  the  factors  thought  to  influence  external  goal  commitment 
were  presented  in  Figure  2.  Thus,  we  posit; 

Hypothesis  2a:  Standards  which  are  communicated  and 
constructed  in  accord  with  the  factors  presented  in 
Figure  2  are  more  likely  to  be  internalized  than  those 
vdiich  do  not.  For  exanple,  standards  that  are  clear,  do 
not  conflict  with  other  standards,  are  tied  to  rewards, 
and  foster  a  sense  of  achievement  will  result  in  greater 
likelihood  of  internalization  by  individual  workers. 

It  should  also  be  noted  that  there  are  a  variety  of  factors 
related  to  goal  difficulty  which  influence  goal  commitment,  such  as  the 
degree  of  challenge  in  the  goal  or  expectancies  for  success.  These 
issues  are  discussed  further  in  a  following  section. 

One  other  factor  which  may  influence  commitment  to  (and  hence, 
internalization  of)  externally  set  performance  standards  involves  the 
degree  to  which  individuals  to  whom  the  standards  apply  participate  in 
the  stemdard  setting  process,  doal  setting  researchers  are  divided  on 
the  importance  of  participatWe  goal  setting  (see  Locke  &  Latham, 

1990) .  However,  researchers  in  other  areas  tend  to  agree  on  the 
importance  of  participation  in  standard  setting  (e.g.,  Dornbush  & 

Scott,  1975;  Drucker,  1954;  Taylor  et  al.,  1983).  Thus,  the  following 
hypothesis  deserves  further  attention  within  the  framework  of  standard 
setting: 


Hypothesis  3;  Standards  which  blcg  participatively  set 
will  be  more  likely  to  be  internalized  than  those  which 
arB  not. 
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Definitional  Content 

When  referring  to  the  definitional  content  of  performance 
standards,  we  are  referring  to  those  aspects  of  performance  vdiich 
define  various  levels  of  standards.  For  example,  a  minimal  performance 
stcindard  can  be  defined  as:  1)  being  of  marginal  utility  to  the 
organization;  2)  meJcing  20  widgets  per  day;  or  3)  not  being  absent  for 
more  than  five  days  a  year.  Another  way  of  considering  the 
definitional  content  is  to  consider  which  aspects  of  performance  should 
be  subject  to  standard  setting  procedures. 

From  em  evaluation  steuidpoint,  the  issue  of  what  should  be  rated 
during  performance  appraisal  has  received  attention  in  the  existing 
literature.  This  literatxire  focuses  on  those  aspects  of  performance 
vhich  are  valuable  parts  of  individual  effectiveness  and  are  amenable 
to  tracking  and  rating.  Prescriptive  accounts  of  standard  setting  point 
out  that  the  content  of  standards  should  be  derived  from  a  careful  job 
einalysis.  Carlyle  and  Ellison  (1984)  provide  the  following  list  of 
attributes,  which  if  truly  considered  vhen  setting  standards  for 
performance  evaluation,  should  result  in  a  high  quality  appraisal 
system: 


1.  Standards  should  be  concrete  and  specific. 

2.  Stcindards  should  be  practical  to  measure. 

3.  Standards  should  be  meaningful. 

4.  Standards  should  be  realistic  and  based  on  a  sound  rationale. 

5.  Standards  should  be  consistent  across  similar  jobs. 

On  the  other  hand,  those  who  approach  performance  appraisal  from  a 
more  cognitive,  descriptive  perspective  (Borman,  1987;  DeNisi  et  al., 
1984;  Feldman,  1981)  would  argue  that  raters  have  their  own  personal 
theories  of  what  aspects  of  performance  are  worthy  of  defining 
standards,  and  it  is  the  rater ^s  personal  standards  vdiich  drive  how 
they  rate  individuals.  One's  personal  theory  of  performance  determines 
what  behaviors  are  attended  to,  how  these  behaviors  are  recalled,  and 
how  these  behaviors  are  interpreted  cind  judged.  Thus,  we  make  the 
following  hypothesis: 

Hypothesis  4:  To  the  degree  that  external  performance 
standards  match  the  internalized  standards  of  raters, 
rater  consistency  will  increase. 

From  a  motivational  perspective,  the  definitional  content  of 
standards  is  important  to  the  extent  that  it  influences  the  type  of 
feedback  that  individuals  receive  and  the  manner  in  which  feedback 
information  is  framed.  In  this  case,  the  focus  is  on  the  internalized 
standards  of  those  to  whom  the  standards  apply.  Based  on  the  feedback 
literature  cited  earlier,  we  make  the  following  hypothesis: 

Hypothesis  5:  To  the  degree  that  external  performance 
standards  match  the  internalized  standards  of  ratees. 
feedback  regarding  those  standeirds  will  more  likely  be 
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accepted  and  perceived  as  appropriate. 

These  hypotheses  suggest  it  is  important  that  externally  set 
performance  standards  are  similar  to  those  adopted  by  both  raters  and 
ratees.  For  example,  suppose  that  for  the  job  of  \iniversity  professor, 
external  standards  indicate  that  professors  are  to  be  judged  upon  the 
amount  of  their  xeseeurch  activity.  However,  if  a  rater  (e.g. , 
department  chair)  feels  that  collegiality  is  of  utmost  importance  to 
the  professor  job,  then  the  rater  will  attend  to  information  which  he 
or  she  perceives  to  be  most  related  to  collegiality,  2md  perhaps  ignore 
or  not  remember  information  related  to  research  activity.  This  problem 
is  compounded  by  considering  the  ratee.  For  example,  in  the  above  case, 
if  the  professor  feels  that  teaching  effectiveness  is  the  most 
important  factor  in  job  performance,  feedback  regarding  collegiality 
and  research  activity  may  be  discotinted  as  unimportant  or  reinterpreted 
to  coincide  with  the  ratee 's  internal  performance  standards. 

Regarding  specificity  of  performance  stemdards,  both  feedback 
literatures  (e.g.,  Taylor  et  al.,  1983)  and  goal  setting  models  (e.g., 
Locke  &  Latham,  1990)  point  out  that  specific  feedback  and  goals  lead 
to  better  motivational  effects  than  vague  feedback  and  goals.  Thus,  to 
the  extent  that  standards  allow  for  concrete  and  specific  feedback  and 
goals,  we  hypothesize: 

Hypothesis  6:  Performance  standards  tdiich  are  defined  in 
specific,  behavioral  terms  will  lead  to  greater 
motivation,  and  consequently  greater  performance,  than 
those  which  are  vaguely  defin^. 

A  third  aspect  to  the  content  of  performance  standards  concerns 
how  the  definition  of  the  standard  is  framed.  Based  on  the  literature 
concerning  framing  (e.g.,  Kahnemaui  &  Tversky,  1979),  it  is  likely  that 
individuals  will  react  differently  to  standards  framed  in  a  positive  or 
negative  format.  According  to  Kahneman  and  Tversky 's  (1979)  prospect 
theory,  individuals  receiving  negatively  framed  information  will  be 
more  risk-seeking  than  those  receiving  positively  framed  information. 
This  suggests  that  standards  defined  with  negative  frames  (e.g.,  misses 
2  to  4  days  of  work  per  month)  will  lead  to  changes  in  behavior  more 
readily  them  those  framed  in  positive  terms  (e.g.,  attends  work  16  to 
18  days  per  month) . 

On  the  other  hand,  the  feedback  literature  (e.g.,  Taylor  et  al., 
1983)  suggests  that  individuals  will  be  less  likely  to  accept  negative 
feedback  than  positive  feedback,  and  will  only  respond  with  increased 
motivation  to  negative  feedback  if  their  expectancies  for  success  on 
future  performzmce  is  relatively  high.  This  body  of  literature  would 
suggest  that  negatively  framed  standards,  leading  to  negatively  framed 
feedback,  may  have  less  positive  effects  (feedback  being  discounted  or 
ignored)  than  positively  framed  stamdards.  While  these  conflicting 
literatures  make  it  difficult  to  develop  specific,  directional 
hypotheses,  the  issue  of  "how  to  frame  the  definition  of  standards" 
clearly  deserves  study. 


21 


T 


Finally,  the  valence  (or  value)  of  standards  is  crucial  to  their 
motivational  potential.  As  specified  in  Figure  2,  goal  setting 
researchers  have  posited  that  external  goal  valence  (associated 
rewards,  punishments,  sense  of  achievement,  opportimities  for  self- 
improvement)  is  a  factor  which  determines  whether  individuals  become 
committed  to  assigned  goals.  Expectancy  theory  (Vroom,  1964)  also 
eurgues  that  the  valence  of  performance  outcomes  is  a  major  influence  on 
motivation.  Therefore,  we  posit: 

Hypothesis  7:  Performance  standards  %Aiid[i  axe  related  to 
outocmes  valued  those  to  \Axam  the  standards  s^ly  will 
lead  to  higher  motivation  and  performance  than  standards 
%rtiich  axe  related  to  performance  outcomes  not  valued. 

Based  on  our  review  of  the  job  satisfaction  literature,  the 
importance  of  attaching  valued  outcomes  to  achievement  of  performance 
standards  was  reiterated,  and  it  was  further  specified  that  outcomes 
associated  with  standards  should  be  perceived  as  fair  reward  for  the 
employee  inputs.  Thus  we  hypothesize: 

Hypothesis  8:  Performance  standards  %diich  result  in  rcwazxis 
%diich  are  perceived  as  fair  given  the  ii^nxts  necessary  to 
successful  performance  will  lead  to  hi^er  satisfaction  than 
standards  resulting  in  outcomes  %hich  are  not  perceived  as 
fair  reward. 

Oiur  review  of  the  job  satisfaction  literature  also  suggested  that 
people  will  be  more  satisfied  when  success  can  be  attributed  to 
personal  qualifications  or  abilities  rather  than  external  factors,  such 
as  luck  or  leadership.  This  suggests  that  performance  standards  be 
defined  by  aspects  of  job  performance  which  primarily  reflect 
individual  effort,  skill,  and  ability.  Thus  we  posit: 

Hypothesis  8:  Performance  standards  whicdi  are  defined  by 
aspects  of  performance  heavily  influenced  by  individual 
effort:  will  lead  to  more  satisfaction  them  standards  which 
STB  defined  by  aspects  of  performance  heavily  influenced  by 
external  factors. 


Communicating  Performance  Standards 

There  is  also  scant  research  on  how  performance  standards  get 
communicated  to  employees.  Above,  several  aspects  of  the  communication 
process  were  hypothesized  to  be  importzmt,  such  as  the  clarity  of  tl.a 
standard's  definition.  The  first  line  of  research  in  this  area  should 
be  descriptive  in  its  attempt  to  identify  the  channels  which 
organizations  use  to  communicate  performemce  standards. 

One  area  of  research  which  may  be  useful  for  exeimining  how,  and 
when,  standards  get  communicated  is  that  on  the  socialization  of 
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newcomers.  For  exanqple,  Feldimm's  (1976)  stage  model  of  socialization 
suggests  that  norms  and  standards  are  most  likely  to  be  commimicated  to 
newcomers  during  the  second  stage  of  socialization,  accommodation.  This 
stage  is  the  point  at  which  the  newcomer's  role  begins  to  be  made 
clear.  Further,  descriptive  accounts  of  socialization  may  inform  us 
about  the  manner  in  v^ich  standards  get  communicated.  For  example.  Van 
Kaanen's  (1976)  description  of  the  socialization  of  police  officers 
points  to  the  importance  of  the  recruit's  Field  Training  Officer  in 
both  stating  and  demonstrating  performance  steuidcurds.  Although  the 
socialization  literature  is  relevant,  it  heis  not  specifically  addressed 
the  issue  of  the  communication  of  performance  standards,  precluding  us 
from  making  specific  hypotheses  about  this  particular  process. 

Murphy  &  Cleveland  (1991)  draw  upon  research  concerning  social 
norms  to  hypothesize  how  standards  get  communicated.  They  point  out  the 
importemce  of  direct  communication,  observing  the  application  of 
standards  to  others,  identification  with  reference  groups,  and  direct 
experience  as  means  by  which  standards  get  communicated.  Again,  vAiile 
existing  research  has  not  explicitly  focused  on  the  comminication  of 
organizational  performance  standards,  all  of  these  processes  deserve 
futtire  study. 

Finally,  our  review  of  the  job  satisfaction  literature  pointed  out 
that  providing  a  rationale  for  external  standards  may  facilitate 
satisfaction.  This  aspect  of  standard  setting  should  be  considered  when 
communicating  performance  standards.  Therefore  we  posit: 

Hypothesis  10:  Communicating  performance  standards  along  with 
a  rationale  will  result  in  greater  satisfaction  than  use  of 
equally  apprc^riate,  but  unjustified,  performance  standards. 


Setting  the  Difficulty  of  Standards 

Performance  standards  are  often  presented  in  terms  of  the  minimal 
level  of  accepted  performance  (Carroll  &  Schneier,  1982) .  However,  as 
argued  earlier,  standards  may  be  set  for  any  level  of  performance  and 
thus,  for  emy  level  of  difficulty.  From  a  motivational  standpoint,  the 
research  reviewed  above  suggests  that  minimal  standards  will  be  less 
effective  than  more  difficult  standards.  Even  the  research  on  the 
effects  of  positive  feedback  (an  outcome  likely  to  result  if  standards 
are  easy)  suggests  that  if  standards  are  easily  attained  and  no  reward 
is  provided  for  meeting  standards,  people  may  actually  become  less 
motivated  (Janz,  1982;  Taylor  et  al.,  1983). 

Of  course,  the  feedback  and  goal  setting  literatures  also  noted 
that  if  their  respective  interventions  are  to  be  effective,  then 
individuals  must  maintain  high  levels  of  expectancy  for  success,  self- 
efficacy,  and  a  sense  of  accomplishment.  This  is  particularly  true  when 
valence  for  the  steuidard  is  not  extremely  high  (Hollenbeck  &  Klein, 
1987) .  Thus, 
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Hypothesis  11:  Individuals  worJcing  under  standards  vhicb 
are  realistically  difficult  %nJ.l  be  more  motivated,  and 
ccsiseguently  perfoxs  better,  than  those  %iDr]dLng  under 
easy  standards. 

The  research  on  job  attitwies  makes  the  same  prediction  about  the 
optimal  level  of  standard  difficulty  as  the  motivation  literature: 
i.e.,  stcmdards  should  be  realistic  but  difficult  enough  to  provide  a 
sense  of  achievement.  Therefore  we  also  hypothesize: 

Hypothesis  11a:  Individuals  working  under  and  meeting 
standards  idiich  are  realistically  difficult  will  be  more 
satisfied  than  those  woiking  under  easy  standards. 

These  hypotheses  point  out  the  impoztcmce  of  doing  research  which 
examines  the  conditions  tinder  vAiich  standards  will  be  seen  as 
difficult,  yet  achievable  and  motivating.  So-called  '‘optimal  level 
theories  of  motivation"  (cf.  Arkes  &  Garske,  1982;  Dember  &  Earl,  1957) 
should  provide  assistance  in  determining  appropriate  difficulty  levels. 
These  theories  posit  an  "inverted-U"  relationship  between  the 
difficulty  of  the  task  and  its  motivating  potential.  The  optimal  level 
of  arousal  (often  called  the  "pacer")  is  determined  by  locating  the 
maximum  value  of  the  inverted-U  function. 

It  should  also  be  clear  that,  for  evaluation  purposes,  there  may 
be  many  levels  of  standards.  For  exanple,  in  the  introduction,  we 
proposed  a  performance  standard  continu\Mn  of:  (a)  a  "minimum"  standard, 
(b)  a  "training  warning"  standard,  (c)  an  "acceptable"  standard,  and 
(d)  an  "excellence"  standard.  In  a  military  context.  Wise  et  al.  (1991) 
adopted  a  related  continuiun  of  "vmacceptable" ,  "marginal", 

"acceptable",  amd  "outstanding".  Their  scale  was  defined  by  the  de^ee 
of  future  training  a  soldier  required,  as  well  as  the  value  (negative 
to  positive)  of  performance  to  the  orgemization.  We  hypothesize  that: 

Hypothesis  12:  Organizations  which  adopt  a  continuum  of 
performance  standards  (such  as  listed  above) ,  rather  than  a 
single  common  standard  across  all  individuals  in  a  particular 
job,  will  increase  individual  motivation  and  subsequent 
overall  organizational  effectiveness. 

In  turn,  organizations  >diich  set  and  emphasize  only  minimum 
performance  stemdards  may  actually  be  demotivating  its  employees. 
Setting  low  external  goals  cem  reduce  an  individual's  intrinsic 
motivation  to  perform  (Deci,  1975) .  We  hypothesize  that: 

Hypothesis  12a:  To  the  extent  that  only  winiimmi  performance 
standards  are  ei^hasized  by  organizations,  (i)  these  minimum 
standards  will  be  internalized,  (ii)  they  will  serve  as 
relatively  easy  individual  goals,  and  (iii)  intrinsic 
motivation  to  perform  at  greater  levels  will  be  reduced. 

Furthermore,  we  note  that  minimum  standards  are  often  adopted 


because  a  judgment  is  made  that  performance  below  the  standard  would  be 
deleterious  to  the  organization.  For  exan^le,  a  company  vrtiich  produces 
bolts  for  high  speed  aircraft  can  not  afford  to  have  "too  many" 
defective  products.  However,  the  notion  of  "too  many"  becurs  closer 
examination,  niat  is,  if  one  defective  product  causes  a  plane  to  crash, 
then  even  one  defect  is  too  many.  Thus,  the  real  "minimal  standard"  is 
no  defective  products.  About  the  only  thing  that  minimum  standards  do 
is  indicate  an  acceptable  tolerance  for  error  (e.g. ,  our  standard  is  no 
more  than  2%  defective  products),  but  the  real  standeurd  is  no  defects. 
This  logic  applies  to  jtist  about  any  situation  (e.g. ,  graduating  at 
least  90%  of  high  school  students  vdien  one  really  wants  to  graduate 
100%) .  Of  course,  the  magnitude  of  this  tolerance  is  a  value  judgment: 
if  less  than  2%  is  acceptable,  why  not  less  than  3%,  and  so  on?  Glass 
(1978)  calls  this  the  "counting  baclcwards  from  100%"  approach  (p.  244). 
Thus,  the  setting  of  minimal  standards  cem  often  be  considered  as 
placing  an  arbitrary  steuidard  error  around  the  real  goal  of  "no 
errors" . 

The  particular  level  of  acceptable  error  is  often  scientifically 
indefensible.  This  has  led  some  researchers  (Austin  &  Bobko,  1985; 
Glass,  1978)  to  conclude  that  standeurds  emd  goals  should  be  cast  in  a 
framework  of  change.  That  is,  one  can  tell  vrtiether  production  (or  any 
other  performance  behavior)  has  gone  up,  remained  the  same,  or  gone 
down.  Psychometrically,  this  focus  on  change  has  the  advantage  of 
having  a  tzxie  zero-point  (i.e.,  zero  change).  Motivationally,  a  focus 
on  change  places  standeuxls  for  behavior  closer  to  the  optimal,  "pacer" 
level  of  intentional  behavior.  Ihus,  we  posit  the  following; 

Hypothesis  12b:  A  focus  cm  the  evaluaticm  of  changes  in 
perforvancm  will  enhancse  individual  motivaticm  and  increase 
subsequent  individual  and  organizaticmal  performance, 
relative  to  the  adopticm  of  minimal  standards  of  performance. 

Also,  as  noted  in  our  review  of  the  job  satisfaction  literature, 
it  has  been  suggested  that  satisfacrtion  may  be  enhanced  when  feedback 
is  presented  in  terms  of  crhemges  (i.e.,  improvements)  in  performance. 
Thus,  we  hypothesize: 

Hypothesis  12c:  A  fcx»s  cm  the  evaluaticm  of  in 

performance  will  enhancm  individual  satisfac:tion,  relative  to 
the  adopticm  of  inflexible  standards  of  performance. 

[There  eure  problems  with  a  fcxrus  on  change,  such  as  measuring  change 
reliably  and  deciding  how  muc:h  cdiange  is  recjuired.  Further,  absolute 
behavior  c:an  not  be  completely  ignored  in  scxne  situations.  However,  we 
believe  the  fcxnis  on  standards  of  change  has  not  been  sufficiently 
exploited  by  organizational  researchers.] 

In  sum,  it  is  clear  that  we  are  suggesting  that  organizations  take 
a  h2ard  look  at  the  notion  of  minimum  stemdards  in  the  workplace.  While 
there  may  be  gocxi  reasons  for  adopting  eund  communicating  minimum 
performance  standzurds,  it  is  critical  for  organizations  to  engage  in 
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answering  the  self>reflective  question,  'H9hy  did  we  do  this  in  the 
first  place?".  We  have  suggested  that  there  might  be  dysfunctional 
consequences  of  setting  only  minimum  performemce  standards.  Further, 
the  process  of  "thinking  back"  to  the  original  reasons  for  any  standard 
is  a  valuable  aspect  of  organizational  analysis  and  strategic  planning 
(Bobko,  1985;  Thompson  &  Strickland,  1990).  As  Thompson  emd  Strickland 
state,  "Policy  helps  ...  translate  the  corporate  philosophy  into  how 
things  eure  done,  how  people  are  treated,  and  tdiat  the  corporate  beliefs 
and  attitudes  wean  in  terms  of  everyday  activities."  (p.242} .  In  fact, 
it  has  been  argued  that  the  questions  eurising  from  sucdi  corporate  self¬ 
reflection  can  only  be  answered  by  an  appeal  to  values  and  ethical 
criteria  (Keeley,  1983)  —  and  we  have  then  come  back  full  circle  to 
the  notion  of  performance  standards  as  being  value  statements. 

Identifying  Performance  levels  from  Utility  Analysis.  The  focus  of 
this  review  has  been  on  employee  reactions  to  performance  stemdards, 
and  not  on  the  psychometrics  of  \rtiere  to  set  cut-points.  Nonetheless, 
is  has  become  cle2ur  that  the  difficulty  level  of  stcuideurds  affects 
employee  reactions.  We  believe  that  recent  psychological  literature, 
which  tries  to  identify  the  function  relating  performance  to  perceived 
value,  can  help  inform  the  appropriate  levels  of  performzo'.ce  standEurds. 

As  noted  above,  Pritchard  et  al.  (1988)  have  developed  functions 
which  map  task  outcomes  (e.g.,  failure  rates  for  a  manufactured 
product)  against  judgments  of  organizational  effectiveness  (see  Figure 
4  for  a  typical  pattern) .  These  judgments  are  presumed  to  be  on  a  ratio 
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Figure  4.  Typical  function  relating  utility/effectiveness  to  task 
per  f  ormamce . 
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scale,  such  that  a  zero-point  of  effectiveness  can  be  identified.  The 
shape  of  these  functions  is  not  linear.  In  fact,  the  effectiveness 
curves  tend  to  be  S-shaped.  Pritchard  et  al.  generated  such  functions 
for  jobs  in  the  U.S.  Air  Force.  It  is  interesting  to  note  that  almost 
identically  shaped  functions  were  independently  developed  within  the 
context  of  the  U.S.  Army's  classification  system  (cf.  Sadacca  et  al., 
1990) . 

We  propose  that  the  non-linearity  of  the  utility/effectiveness 
fxinction  can  be  exploited.  For  exanple,  point  "c"  on  the  task  output 
dimension  (horizontal  axis)  would  be  a  likely  C2mdidate  for  a  "standard 
of  perform2mce  excellence".  That  is,  from  2m  organizational  point  of 
view,  increasing  perform2mce  beyond  this  already  high  level  shows 
little  meurginal  gain  in  organizational  effectiveness  (and  an 
individual's  motivation  might  best  be  directed  to  other  coitponents  of 
the  job  once  performance  reaches  level  "c"  on  this  component) . 

Further,  there  are  two  candidates  for  "minimum  performance" 
standards  in  Figure  4;  i.e.,  points  "a"  and  "b".  If  the  effectiveness 
scale  is  truly  ratio  in  nature,  then  point  "b"  should  be  set  as  the 
minimum  stamdard,  since  performance  below  this  standard  yields  negative 
returns  to  the  organization.  However,  the  psychological  literature 
demonstrates  that  the  construction  of  truly  ratio  scales  is  not  easy. 
Therefore,  point  "a"  identifies  another  candidate  for  the  minimum 
performance  standard  —  below  this  point  all  performance  is  equally 
poor,  ^rtiile  above  this  point  motivated  effort  may  lead  to  gains  in 
organizational  effectiveness.  In  either  case,  we  hypothesize  that: 

Hypothesis  13;  Organizations  %rtiich  set  multiple  perform2ince 
standards  defined  by  natural  breaks  in  utility/effectiveness 
functions  will  show  increased  organizational  effectiveness, 
relative  to  other  organizations. 

Of  course,  standards  which  are  set  using  such  functions  should  be 
inspected  for  their  reasonableness,  specificity,  and  acceptability,  as 
well  as  any  other  characteristics  noted  in  the  prior  hypotheses. 


CONCLUSIONS  AND  THE  ARMY  CONTEXT 


The  Army  Synthetic  Validity  Project 

In  the  late  1980 's  the  US  Army  sponsored  a  project  to  investigate 
the  transportability  of  selection  and  classification  equations  from 
known  Military  Occupational  Specialties  (MOS)  to  new,  or  unstudied, 

MOS.  In  order  to  help  generate  and  investigate  the  utility  of 
synthetically  generated  selection  devices,  a  substantial  portion  of 
this  project  was  devoted  to  how  the  Army  might  set  performance 
standards  within  MOS  (in  order  that  selection  cutoffs  could  be  related 
to  success  rates  on  performance) .  This  "st2mdard  setting"  aspect  of  the 
synthetic  validity  (SYNVAL)  project  is  one  of  the  largest  empirical 
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investigations  about  performance  stemdard  setting  in  the  field  of 
industrial  psychology.  An  extensive  summary  of  the  results  may  be  found 
in  Wise  et  al.  (1991). 

The  SYNVAL  project,  after  en^iirical  amd  theoretical  consideration 
of  many  alternatives,  settled  on  the  investigation  of  two  procedures 
for  setting  standards:  a  task-based  approach  emd  an  incident-based 
approach.  The  task-based  approach  required  raters  to  identify  the 
percentage  of  task  steps  (percent  GO  scores)  that  woiild  be  required  to 
attain  particular  standards  of  job  performance  (unacceptable,  marginal, 
acceptable,  outstanding) .  The  incident-beised  approach  required  raters 
to  rate  behaviorally-based  samples  of  job  performamce  as  either 
unacceptable,  marginal,  acceptable,  or  outstanding.  The  percentage  of 
current  Army  soldiers  vAio  fell  into  each  of  these  categories  using  each 
of  these  two  methods  could  then  be  calculated  using  known  empirical 
distributions  of  incumbent  performance  2uxi  incumbent  behavioral 
incident  ratings. 

As  noted  by  Wise  et  al.  (1991),  "The  most  significant  conclusion 
of  the  standard  setting  research  was  that  the  different  methods  that  we 
developed  and  evaluated  led  to  different  results"  (p.  viii) .  In 
particular,  stzmdards  set  using  the  task-based  method  were  stricter 
th€m  the  standards  using  the  incident-based  method,  particularly  for 
the  lower-level  cutoffs  (e.g.,  marginal  performance). 


SYNVAL  Results  as  Value  Judgments 

The  SYNVAL  results  are  certainly  consistent  with  oior  review  above, 
in  the  sense  that  different  procedures  result  in  different  answers  fwhv 
this  occurs  is  considered  in  the  next  section) .  Ihis  is  what  one  would 
expect  of  value  judgments  —  they  are  affected  by  the  context  in  which 
they  are  derived.  Second,  it  is  obvious  that  if  one  wants  to  set  more 
difficult  standards  (with  all  the  resulteint  properties  noted  above) , 
then  the  Army  should  choose  a  task-based  standard  setting  procedure.  Of 
course,  doing  so  would  imply  that  a  greater  percentage  of  current  Army 
incumbents  are  "unacceptedsle"  euid  that,  once  again,  is  a  value  judgment 
which  needs  to  be  considered  by  the  organization  as  a  whole.  However, 
we  believe  that  the  interesting  psychological  research  implied  by 
SYNVAL's  finding  concerns  whv  the  differences  occurred.  This  issue  is 
now  considered. 


Maximal  Versus  Typical  Performance 

Based  on  the  development  of  the  two  standard  setting  methods  (a id 
the  instructional  sets  they  evoked).  Wise  et  al.  (1991)  conjectured 
that  task-based  standards  were  based  on  perceptions  eiixsut  meocimal, 
"can-do"  soldier  performance  while  incident-based  stemdards  were  based 
on  perceptions  about  a  soldier's  typical,  "will-do"  levels  of 
performance.  Further,  Sackett,  Zedeck,  and  Fogli  (1988)  have 
investigated  the  commonly  used  terms  of  maximal  amd  typical  performance 
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emd  found  relatively  low  correlations  between  these  two  performance 
measurements.  One  implication  is  strai^tforward:  vhen  setting 
performance  stemdards,  the  Army  (emd  pzobably  most  other  orgcinizations) 
need  to  consider  whether  these  standzurds  should  be  set  on  maximal  or 
typical  performance  (or  some  combination  of  the  two) .  Otherwise, 
confusion  between  the  two  measures  could  be  a  source  of  rater/ratee 
disparity  (noted  earlier) ,  lack  of  goal  clarity  (noted  earlier) ,  or 
create  unintended  difficulty  levels  of  performcince  standards. 

It  may  be  that  standards  based  on  typical  performemce  are  adequate 
under  peacetime  conditions.  On  the  other  hand,  maximal  performance 
standards  might  be  more  critical  (i)  during  hostilities,  (ii)  on  tasks 
for  vrtiich  there  are  no  back-up,  "fail-safe"  remedies  or,  (iii)  on  tasks 
vrtiich  are  rated  as  having  a  high  cost  of  error.  Future  research  should 
systematically  delineate  the  organizational  and  environmental 
conditions  under  which  the  Army  might  wemt  to  use  maximal  versus 
typical  performance  standards. 

Further,  it  is  theoretically  interestii*g  to  suggest  that  the 
difference  between  a  person's  typical  performance  and  his/her  maximal 
performance  can  be  considered  as  an  index  of  a  soldier's  motivation  to 
perform.  As  such,  a  research  hypothesis  would  be  that  the  difference 
between  maximal  and  typical  performance  will,  as  a  motivational  index, 
be  related  to  other  constructs  in  the  nomological  net,  such  as 
commitment  to  the  organization  (Army) .  Indeed,  the  SYNVAL  results  noted 
in  the  introduction  of  our  review  indicate  that  this  difference  is 
substantial  in  the  Army  context:  the  cutoff  for  "marginal"  performance 
using  the  incident -based  method  is  at  the  6th  percentile  of  current 
Army  performance;  the  cutoff  for  "marginal"  performance  using  the  task- 
based  method  is  at  the  29th  percentile  of  performance  (see  Wise  et  al., 
1991,  Table  5.23).  Thus,  there  may  be  lots  of  opportianity  for  increased 
improvement  in  Army  performance  by  focusing  on  maucimal  performance 
stemdards . 


A  Qualitative  Comment 

During  an  interview  with  Army  sv^Dject  matter  experts,  we  asked  the 
question,  "When  a  soldier  thinks  about  'performance  standards',  what 
does  that  soldier  think  about?"  The  amswer  was,  "The  soldier  probably 
thinks  of  a  list  of  tasks  suitadsle  to  his/her  NOS  and  assumes  that  all 
tasks  should  be  capable  of  being  performed."  This  is  a  form  of  the 
"counting  from  100%"  approach  considered  earlier  in  this  paper.  That 
is,  the  standard  is  performance  capability  on  all  tasks,  with  some 
allowable  slippage,  below  that  standard.  However,  SYNVAL' s  findings  for 
the  task-based  standard  setting  approach  would  indicate  that  the 
organizational  reality  is  far  from  this  "counting  back  from  100%" 
stemdard.  (Indeed,  the  instructions  used  in  that  portion  of  the  project 
directed  subject  matter  experts  to  consider  less  than  100%  performance 
as  being  acceptable. )  As  already  noted,  the  task-based  results  indicate 
that  "marginal"  performance  is  at  the  29th  percentile  of  incumbent 
distribution.  Further,  this  same  study  indicates  that  only  20%  of  the 
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current  soldiers  could  be  labeled  "outstanding".  Clearly,  Lhe 
conjecture  about  a  typical  soldier ^s  statement  ^U1d  ^e  orgcuiization's 
reality  eure  not  congruent. 


Individual  Performance  and  Satisfaction 

It  has  been  our  working  assumption  that  performance  standcirds  are 
set  and  communicated  by  almost  all  organizations,  including  the  Army. 

We  have  drawn  upon  literatures  related  to  motivation,  performance,  and 
job  affect  in  order  to  focus  attention  on  a  new  issue:  i.e.,  how  people 
react  to  performance  standards.  The  reader  is  referred  back  to  our  list 
of  hypotheses  for  future  research  emd  new  considerations  in  the  setting 
of  performcuice  standards.  Our  paper  proposes  that  standards  ceui  be  used 
to  motivate  and  help  retain  employees  in  addition  to  being  a  means  for 
assessing  performemce.  Specifically,  we  hypothesize  that  the  Army  can 
increase  motivation,  and  consequently,  individual  performance  by 
setting  performance  stemdards  vrtiich  are  1)  congruent  between  soldiers' 
internal  standards,  v^at  the  Army  says,  emd  v^at  the  Army  does;  2} 
specific;  3)  tied  to  valued  rewards;  4)  accepted  by  the  soldier;  and  5) 
set  at  challenging  levels  of  difficulty.  Furthermore,  standards  set  in 
this  manner  should  also  lead  to  increased  job  satisfaction  and  more 
positive  affect  toward  the  job,  leading  to  increased  levels  of  soldier 
retention.  All  of  these  effects  are  further  hypothesized  to  occur 
through  the  mediating  mecheinism  of  the  internalization  of  externally 
set  performance  standards,  suggesting  future  research  in  the  area  of 
how  soldiers  interpret  and  accept  standards  set  by  the  Army.  We  believe 
that  the  research  areas  outlined  in  this  paper  will  be  fruitful.  While 
several  of  these  relationships  are  assumed  to  exist  by  some  management 
textbook  writers  (see  most  chapters  on  setting  business  policy  and 
subsequent  performcince  objectives) ,  there  is  little  direct  empirical 
evidence  examining  how  employees  react  to  performance  standards.  The 
hypotheses  herein  should  help  guide  this  necessary  empirical  research. 
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